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o Information showing start position capable of 
processing data or not 

• Flag for random access (Random access flag), 
e.g. Intra-frame (I-picture) in the case of 
picture 

• Flag showing access unit (Access flag) , 
e.g. Frame in the case of picture , GOB unit 



AL : Adaptation layer 
ES : Elementary stream 
PTS : Presentation- time -stamp 



Header 
information 
of data 



Data (Picture or sound for each frame) 




Information showing start position capable of 
processing data or not 

Information showing data reproducing time (PTS) 
Information showing data processing priority 



- 
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°TS:Transport stream(Transmission packet) 



TS 




AL 



ES 




Communication 
header 



AL 



ES 



Communication 
header 

— r— 

• Information showing start position capable of processing 
pieces of data or not 

• Identification number for showing data sequence(Sequence 
number) 

• Time concerned with transmission of pieces of data 
o Handling time stamp and marker bit 



(a) 


Communication 
header 


AL 


ES 




f 

Time stamp 





PTS or not (Additional) 



(b) 



Communication 
header 

¥ 



AL 



T 



ES 




Time stamp for 

communication 

header 



Time stamp PTS or not (Additional) 



(c) 



Communication 


AL 


ES 


header 





MarkerBit 



Substituted by 
AL flag (Additional) 



(d) 



AL 



ES 




MarkerBit of 

communication 

header 



Communication 
header 

f 

MarkerBit 

(It is interpreted that random access flag 
and access flag are present in AL.) 
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H.223 or 
the like 



Group 
MUX 



Data and 

control information 



UDP/TCP/RTP 



Intra- net and inter-net 

or the like 



F i g 
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Broadcast program transmitting procedure 

<Broadcast type and communication type including return channel) 
Transmitting side Receiving side 

Transfer of data structure 



ACK/Reject 



(LCN 0) : (*1) 



Transfer of corresponding data 
(From each port) : (*2) 



Are processing and 
reception possible? 
.Start decoding of 
data which can be 
decoded and display 
it. 



<Broadcast type (with no return channel)) 

Transmitting side Receiving side 

Transfer of program 
information and data structure 
(LCN O) : UDP(*3) 



Transfer of corresponding data 
(From each port) : UDP 



(*1 ) Must be a system for detecting and retransmitting a packet 

loss like TCP. 
(*2) RTP/RTCP or TCP/IP 

(*3) Same data (picture or sound) or control information (broadcast 
program or data structure) is continuously repeatedly 
transmitted. A packet is detected and sequence is kept at a 
receiving terminal in accordance witha sequence number. (To be 
used in a local closed region. Traffic becomes too large.) 
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1 O ( a ) 



Receiving terminal 



Control information 
or data 



Program or data 
to be required 



Flag, counter, 
or timer showing 
point of time to be 
required 



Main i 
looking-Ustening - 
section 






Auxi 
looking- 
sec 


liary 

listening 

tion 




Storing 
section 



Output 
section 



i 



1 O ( b ) 

Receiving terminal 



Control information 
or data 



Main 

looking-Ustening 
section 



Caption 
broadcast-program 
receiving section 



Output 
section 



Storing 
section 
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Fig. 11(a) 



hierarchical image of object> 




transmission image of object> 
<1. Broadcast type > 




<2. Communication type> 

RTP/RTCP (Program ID of each logical 

channel is fixed, ) 





««£ 


> 




Terminal 


-«= 


5» 


Terminal 


A 


-< 


> 


B 









LCNO (control) 



i s . 11(b) 
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-Capability exchange def initions(original from H.245) 



Terminal CapabilitySet 
{ 

sequenceNumber 



::=SEQUENCE 
SequenceNumber., 



multiplexCapability 
capability Table 

capabilityDescriptors 
mpeg4Capability 



MultiplexCapabilityOPTIONAL 
SET SIZE0..256) OF Capability 
TableEntryOPTIONAL, 
SET SIZE0..256) OF Capability 
DescriptorOPTIONAL, 
MPEG4CapabilityOPTlONAL. 



} 



Fig. 12 , 5 / 5 7 



-MPEG4 Capability definitions 



MPEG4Capability 
{ 

sequenceNumber 

NumberOfProcessObject 

{ 

MaxNumberOf Video 
MaxNumberOf Sounds 
MaxNumberOf Mux 

} 

reconfigurationALCapability 
} "' 

MPEG4CapabilityAck 
sequenceNumber 

} "' 

MPEG4Capability Reject 
{ 

sequenceNumber 
NumberOfProcessObject 

maxNumberOf Video 

maxNumberOf Sounds 

MaxNumberOf Mux 

} 

reconf i gurationALCapability 



::=SEQUENCE 

SequenceNumber, 
SEQUENCE 

INTEGER(0..1023), 
INTEGER(0..1023), 
INTEGER(0..1023), 
BOOLEAN, 

::=SEQUENCE 
SequenceNumber, 

::=SEQUENCE 

SequenceNumber, 
SEQUENCE 

MaxNumberOf Video, 

MaxNumberOf Sounds 
maxNumberOf Mux, 
BOOLEAN, 
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F* i & . 13(a) 



—Group MUX definitions 



CreateGroupMux 
i 

sequenceNumber 
Group MuxID 
lanportNumber 

} 

CreateGroupMux Ack 
^ sequenceNumber 

CreateGroupMuxReject 
{ 

sequenceNumber 

cause 

{ 



::=SEQUENCE 

SequenceNumber, 

INTEGER(0..1023), 
LANPortNumber, 



::=SEQUENCE 
SequenceNumber, 

:: = SEQUENCE 

SequenceNumber, 
CHOICE 
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i s . 13(b) 

DestoryGroupMux 
{ 

sequenceNumber 
GroupMuxID 

\ "' 

Des tory Group Mux Ack 

{ - 

sequenceNumber 
} "' 

Des tory Group MuxReject 
{ 

sequenceNumber 

cause 

{ 

} 

} 



:: = SEQUENCE 

SequenceNumber, 
INTEGER(0..1023), 

:: = SEQUENCE 
SequenceNumber, 

:: = SEQUENCE 

SequenceNumber, 
CHOICE 



F~ i e. 
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13(c) 



PortNumberStructure 



::=SEQUENCE 



sequenceNumber SequenceNumber, 
lanPortNumber LANPortNumber, 
numberOfLogicalNumber INTEGER(1..15), 
SEQUENCE SIZE0..15) OF PortStructureElement, ■ 



} 

PortStructureElement 



{ 



logicalPortNumber 



} 

Po'rtNumberStructureAck 
{ 

sequenceNumber 



::=SEQUENCE 
LogicalPortNumber, 

::=SEQUENCE 
SequenceNumber, 



PortNumberStructureReject 

^ sequenceNumber 
cause 
{ 



::=SEQUENCE 

SequenceNumber, 
CHOICE 
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—Logical channel signalling definitions(original from H.245) 
-MPEG4 Object Create Operation(for LANPortNumber) 



OpenLogicalChannel ::=SEQUENCE 

{ - 

fowardLogicalChannelNumber LogicalChannelNumber, 

fowardLogicalChannelParameters SEQUENCE 

{ 

portNumber INTEGER(0..65535)OPTIONAL, 
dataType DataType, 
multiplexParameters CHOICE 
I 

h222LogicalChannelParameters H222LogicalChannelParameters, 

h223LogicalChannelParameters H223LogicalChannelParameters, 

v76LogicalChannelParameters v76LogicalChannelParameters, 

* * * j 

h2250LogicalChannelParameters H2250LogicalChannelParameters, 
h223AnnexALogicalChannelParameters 
H223AnnexALogicalChannelParameters 
MPEG4LogicalChannelParameters MPEG4LogicalChanelParameters, 

}, 



} 



}, 



i 



1 5 
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MPEG4LogicalChannelRarameters ::=SEQUENCE 



I 

-H.225BASE 
LANportNumber 
ProgramID 
ProgramName 

} • 

BroadcastChannelProgram 



{ 



sequenceNumber 
numberOfChannelNumber 



INTEGER(0.. 65535), 
INTEGERC0..255), 

0CTETSTRING(SIZE(128)), 



"SEQUENCE 

SequenceNumber, 
INTEGER(0..1023), 



SEQUENCE SIZE(1..1023) OF MPEG4LogicalChannelParameters 



i 



ChangeLogicalChannelAttribute 



sequenceNumber 

lanportNumber 

ProgramID 



} 

ChangeLogicalChannelAttributeAck 
sequenceNumber 

} 

ChangeLogicalChanneLAttributeReject 

sequenceNumber 
cause 

{ 



::=SEQUENCE 

SequenceNumber 
LANPortNumber, 
INTEGERC0..255), 



::=SEQUENCE 
SequenceNumber, 

::=SEQUENCE 

SequenceNumber, 
CHOICE 



} 



3r«" i f£ 
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J_ e( a ) 



-MPEG4 Object Class definition 



MPEG4 Object Class definition 



{ 



} 



sequenceNumber 
ProgramlD 

NumberOf Object sList 
SEQUENCE SIZE0..1O23) OF 



ObjectStructureElement 



{ 



0 



SSRC 

LANPortNumber 



ScrambleFlag 
CGDOffset 
MediaType 



::=SEQUENCE 

SequenceNumber, 

INTEGER(0..255), 
INTEGERC0..1023), 
ObjectStructureElement 

::=SEQUENCE 

INTEGERC0..16777215), 
INTEGER0O24.5OOO), 

— forRPT(Video&Sound.) 
BOOLEAN, 
INTEGERC0..255), 
INTEGER(0..255), 



} 



MPEG4 Object Class def initionAck 



{ 



sequenceNumber 



MPEG4 Object Class def initionReject 

sequenceNumber 

cause 

{ 



::=SEQUENCE 
SequenceNumber, 

::=SEQUENCE 

SequenceNumber, 
CHOICE 
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F i & . 16(b) 



-Adaptation Layer Reconfiguration Request definitions 



ALReconf iguration 



{ 



sequenceNumber 
RandomAccessFlagMaxBit 
PresentationTimeStamp sMaxBit 
CGDPriorityMaxBit 



::=CHOICE 

SequenceNumber, 
INTEGERC0...2), 
INTEGER(0...32), 
INTEGER(0...8), 

--forVideo and Sound 



—Adaptation Layer Reconfiguration Response definitions 



ALReconf iguration Ack 
{ 

sequenceNumber 

} 

ALReconf igurationReject 
{ 

sequenceNumber 

cause 

{ 



::=SEQUENCE 
SequenceNumber, 

::=SEQUENCE 

SequenceNumber, 
CHOICE 



} 



<Relation between AL, ES, and RTP> 
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F~ 1 & . IT 



•Setup Program and Data Request definitions 



Setup Request 



{ 



sequenceNumber 

SSRC I MEGER(0.. 16777215 )2"3 2, 



::=CHOICE 
SequenceNumber, 



Logical Channel Number, 
setupitem 

{ 

executeProgramNumber 
dataNumber 

executeCommandNumber 

U 

not itycounter 
{ 



flag 
counter 
timer 



INTEGER0024...5000), 
CHOICE 

INTEGER(0...255), 
INTEGER(0...255), 
INTEGER(0...255), 

CHOICE 

BOOLEAN 

INTEGER(0...255), 
INTEGER(0...255), 
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—control and AL attribute definitions 



Control ALdefinition ::=CHOICE 
{ 

sequenceNumber SequenceNumber, 

AL CHOICE 

RandomAccessFlagUse BOOLEAN, 
PresentationTimeStampUse BOOLEAN, 

CGDPriorityUse BOOLEAN, 



2 5/57 

i & . 1 Q( a ) 



classES_header{ 

uint(4) headerlD; 

u i nt (24) buf f erSizeES; 

uint(1) useTimeStamps; 



- u i n t ( 1 6 ) sequenceNumberMaxBit; 
u i nt ( 1 ) useHeaderExtension; 
if (useHeaderExtension)! 

u i nt ( 1 ) accessllintStartFlag; 
uint(1) randomAccessPointFlag; 
uint(1) OCRsetFlag; 
U i nt (4) degradationPriorityMaxBit; 

} 

uint(3) reserved: 

} 



2 6/57 



Fig 



lO(b) 



-Adaptation Layer PDU header configuration Requestand Command definition 



AL configuration 



{ 



sequenceNumber 
defaultHeaderConfiguration 
header ID 

MPEG4ALPDUHeaderConfig 
{ 

accessllintStartFlag 

randomAccessPointFlag 

OCRsetFlag 

degradationPriorityMaxBit 



::=SEQUENCE 

SequenceNumber, 
BOOLEAN, 
INTEGER(0..4), 
SEQUENCE 

BOOLEAN, 
BOOLEAN, 
BOOLEAN, 
INTEGERC0..4), 
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Processing at receiving terminal under overload(Common to dynamic 
picture and sound) 

Thread for processing sound at system level is previously set it's 
processing priority to a value higher than that of thread for 
processing picture. 

SteplOI 



Frame_skipped 
. =FLASE 



Set priority of 

frame to be 
disused to value 

larger than 
(CutOffPriority) 
"maxPriority". 



Value of resolution of 
priority to be added to 
frame, CGDoffset(Can be 
determined in accordance 
with receiving-terminal 
performance) is transmitted 
as control information. 



Step 103 



Step 102 



CutOffPriority++ 




Cutoff P.riority=0 



CutOffPriority 
=maxPriority 



Frame_skipped=TRUE 
and frame type=P frame 



YES 



Step 104 



Frame priority+(CGDof f set) 
^ CutOffPriority 

YES 



Frame_skipped=FLASE, 

i 



Frame skipped 

=TRUE 



Deliver data to decoder. 

i 
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RTP header 



H.263 payload header 



H.263 bitstream 



oMode A: GOB, picture boundary 

Presence or absence of mode or PB, start 
and end positions of bit stream, and 
execution timing states of options of 
resolution, frame type, and H.263 



DBQU ANT,TR(f or B frame), 
TR(for P frame) 



Core 
• infor- 
mation 



To be set when 

PB frame is present 



o Mode B: MB boundary without PB 

Core information for Mode A 

Information for quantization value (GQUANT) , GOB number , 
absolute address of first MB in GOB. and movement vector 
(Horizontal and vertical directions) 



oMode C: MB boundary with PB 

Information for Mode B 

DBQU ANT, TR (for B f rame),TR(f or P frame) 



Relating of communication payload 



Transmitting- 
slde terminal 



Mode A 4- Layer No. 
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Configuration information 



Receiving - 
side 

terminal 
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Start 



801 



Input picture. 






i 
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YES 



Generate and multiplex 
data string. 



808 



Start 
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9 



Initialize execution 

time (a i) of each 

element. 



• Input multiplexed 
data and measure time 
required to input 
multiplexed data. 

i 

Output variable-length 
code and data string. 

I 

Fetch execution 
frequency from data 

string and set 
execution frequency 
to x i. 



Calculate execution 
frequency in 

accordance with x i 

and a i. 
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Start of decoding routine 



Jl 



Start time 
measurement. 
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To decoding 
routine 
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Complete time 
me asurement. 
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Estimate execution 
time of each element 
and up date a_i. 
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End of decoding routine 
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Receive data string 
and fetch and set 
execution time of 
each processing. 
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Generate and 
multiplex data 
string. 



Start 
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Initialize each 
execution time. 



Input picture. 
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1001 
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Divide macroblock. 
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Decide intra/inter on 
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i — 



Decide execution 
frequency. 
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Movement 
compensation 
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Processing 
"of every macroblock" 
completed? 
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-4- 3 
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IntiaLize execution 

time a i of each 

processing. 



Jl 



Input frame rate. 



1102 
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1104 



Estimate 
execution time of 
each processing 
and update a_i. 



808 



Generate and 
multiplex data 
string. 
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Input picture. 
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Decide intra/inter on 
every macroblock. 
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Decide execution 
frequency. 
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Start execution 
time measurement. 
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804 
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compensation 
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Processing 
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completed? 
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End execution 
time measurement. 
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